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ABSTRACT 


A modified cost-benefit model is developed to evaluate 
alternative military equipments for installation aboard 
existing Coast Guard vessels. Life-cycle costs of alter- 
Mative systems are used to estimate alternative systems 
cost. Identified are the relevant cost elements to the 
Coast Guard that should be included in the life-cycle cost 
equation. Benefits are measured in terms of the alterna- 
tive's impact on assigned peacetime missions of the vessel. 
To arrive at an estimate of an alternative's worth over all 
missions a multi-attribute technique is used. Assumptions 
and problems associated with using multi-attribute selection 
criteria are discussed. The proposed model is developed 
Hor the case where the additive function criterion is 
deemed appropriate. A constant-sum method is developed 
to use subjective judgement of experts to arrive at ratio 
scale benefit values for the alternatives. However, the 
actual implementation of the model is contingent on NOSC's 


factor analysis of attributes currently under development. 
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I. INTRODUCTION 


Increasing emphasis within the Coast Guard is being 
placed on evaluating military systems in terms of their 
peacetime benefits. Evaluating military systems in terms 
of their expected peacetime benefits has evolved due to 
the greater number of combat systems installed on new class 
vessels. The importance attached to this concept in the 
systems selection for the Coast Guard's new 270 foot medium 
endurance cutter (MEC) is exemplified in the following 
statement. 

Right from the beginning, the dialogue 
with the Navy demonstrated the importance 
which they viewed the program (270 MEC) 
and the benefits which would accrue from 
our use of combat systems for peacetime 
mission. 

Measuring the expected peacetime cost of the alternative 
military systems is a complex task. The system's physical 
characteristics such as weight, volume, and power require- 
ments are in reality cost elements. Shore as well as 
Shipboard manpower requirements and system acquisition 


costs should also be classified as cost elements. For new 


class cutters, selecting military equipments includes the 


Moore, R.G., "MEC-270", The Bulletin, U.S. Coast 
Ema Alumni Association, Vol. 39, No. 2, March/April 1977, 
CEP 





requirement of trading off peacetime missions for added 
military Capability as limited personnel and budget 
constraints influence the actual size and missions of new 
platforms. Due to these constraints, increasing the 
military capability of a platform can only be accomplished 
by four alternative methods. These are: 


1. Increase the size of the platform to accommodate 
ar rmeguipments. 


o a a oaa ae ied. but reduce the peacetime 
missions to be performed. 


er VUetirze Unused Space on a platform for military 
Sres also nerede personnel requirements. 


4. Utilize unused space on a platform for military 
systems whose benefits eliminate the need for 
certain peacetime equipments, but still allow all 
acc Sons tO be performed. 

SReeess.ulsımplementation Of any Of the four alternatives 
requires careful analysis of the actual benefits a military 
System provides. Naval Ocean Systems Center (NOSC) San 
esos Calitormia, 1S Currently developing a multi-attribute 
selection methodology primarily designed to address the 
fourth alternative of providing increased military capability 
On new class cutters. Appendix A presents a tentative outline 
of the methodology NOSC is developing. 

The purpose of this paper is to extend the concept of 
evaluating military systems in terms of their expected 
meeecetime benefits for existing cutters. A modified cost- 
benefit methodology is developed that may be used in 


conjunction with NOSC's methodology to help verify that the 


System with the greatest expected peacetime benefits has 





been chosen. When the application of the cost-benefit 
nooo NOS technique result in the selection of the 
same system, the credibility of the study is strengthened. 
This is possible since the proposed cost-benefit model 
requires a different set of assumptions than NOSC's 
methodology. Unfortunately, even complete agreement among 
the two methodologies does not fully ensure the best system 
has been selected. Both the NOSC methodology and the 
proposed cost-benefit model require the assumption that 
the wholistic problem of system selection may be decomposed 
into a number of smaller dimensional problems which separately 
iemamenemselyes to analysis. The requirements necessary to 
decompose a wholistic problem into smaller parts are admit- 
edly quite restrictive. 

momo pro dolo proposed in this discussion is not a 
ost benetit model from classical economic theory. Cost- 
Denerit models are techniques used by analysts to evaluate 
non-market decisions. Most often cost-benefit techniques 
are applied to decisions affecting public goods. Examples 
Of public analysis include studying the impact of building 
mew Gam Or the desirability of building a Federal court- 
house. Cost-benefit models determine the desirability of 
public goods by measuring the dollar cost of the project 
mae then comparing this to a dollar-value estimate of the 
mentre received. Thus, the building of the dam may cost 
Mami ion dollars but the increased irrigation provided 


EE agriculture output by 20 million dollars in 





cthesarea and also provide recreational facilities. The 
Pop os cd metio dolosy ina this discussion does not attempt 
Ceo aa a dollar value on the benefits. Instead, it 
Perales arte elna que Wiére costs are estimated by life- 
Sa oe aid benetits are measured in a restricted way 
by comparing the expected impact of alternatives on peace- 
mene missions. The intended use of the proposed cost- 
benefit model is to aid the decision-maker in arriving at 
Eat ıomal choice. Tr 15 not intended to replace the need 
mora decision-maker. 

The proposed cost-benefit model requires two assumptions 
Meton to those necessary to use multi-attribute 
erection criteria. These are: 


1. Missions assigned to existing cutters currently 
Ee EE assignment Of new missions. 


2. the alternative systems list prepared by the Navy 
include only systems which are capable of fulfilling 
enea cated military mission. 

The first assumption is necessary as only benefits that 
accrue to existing peacetime missions are considered when 
comparing alternative systems. If one of the selection 
eee onns ro evaluate alternatives Dy considering their 
impact on increasing the number of peacetime missions an 
awet ing cutter could perform, this model should not be used. 
reality, however, the second assumpticn does appear 
measonabie tor existing class cutters. Current and projected 
operational commitments indicate that existing cutters are 


Demme fully utilized. Thus, even if an alternative could 


miereasc the number of peacetime missions performed, current 
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resource limitations and time constraints prohibit assigning 
dae onae etime missions to existing cutters. Appendix 
B presents the number of additional platforms required to 
e nadate existing Cutters with their presently assigned 
missions. Shortages of platforms in every class cutter 
indicate that the addition of new missions is not currently 
feasible. 

The second assumption is more restrictive and in many 
cases may severely limit the use of this model in evaluating 
military systems. This assumption is necessary as no 
Memetits accrue for the system's ability to perform the 
military mission. Since it is reasonable to assume that 
anma Navy would place on the alternative list only those 
Systems which could perform their intended military use, 
this assumption is plausible when evaluating systems by 
Aer impact On peacetime missions. 

ino discussed the assumptions required prior to 
Miplemeiting the proposed cost-benefit study, further 
desumptions required of the specific model are discussed 
as they arise throughout the discussion. The actual need 
for the Coast Guard to evaluate military systems by their 
peacetime benefits is discussed in Chapter Two. Identified 
w Chapter Three are the cost elements relevant for the 
Coast Guard and a life-cycle cost formula is developed to 
da mate the cost of the various alternatives. An example 
Problem on applying the life-cycle cost equation is presented 


for the case where Coast Guard manpower requirements are 


11 





Sacco IAN ay sa lso discussed in Chapter Three 
is the importance of properly measuring externalities 
associated with alternative systems. Finally, a brief 
discussion on the problem of evaluating a system cost per 
Medico Systems With unequal lifetimes is presented. 
Chapter Four discusses the assumptions necessary to use 
wea attribute theory in estimating the expected benefit 
ee Of the systems. Specific requirements and limitations 
Of using the selection criteria of dominance, minimax and 
maximin, lexicography, utility theory, and the additive 
function form are presented. Also included are the 
different measurement scales each selection criteria utilizes. 
@iicpter Five proposes a constant-sum model to estimate 
peacetime benefit ratios for each alternative system. This 
technique produces a ratio scale estimate of each system's 
expected benefit which is required in a cost-benefit analysis. 
Finally, Chapter Six discusses the specific assumptions and 
limitations required to use the constant-sum method. Also 
presented in the conclusions are specific recommendations 
where further study should be conducted prior to implementing 
the proposed cost-benefit model. 

imi one tunther point merits discussion. The actual 
implementation of the proposed model is contingent upon the 
completion of a factor analysis study to identify the 
independent attributes that, when combined, collectively 
describe the peacetime missions a cutter performs. This 


day 1S currently being conducted by NOSC and their results 


EZ 





will be the list of attributes required for this model. 
Appendix C presents a partial glossary of possible attributes 


that are currently being analyzed at NOSC. 





IN CE GROUND OPR THE NEED TO EVALUATE U.S. 
NAMES YSTEMS BY THE COAST GUARD 

The need for the Coast Guard to carefully examine 
available United States Naval military systems is great. 
The two major factors that are increasing the importance of 
carefully evaluating Naval equipments are: 

* Increasing costs of electronic surveillance equipment 

Bebe De Coast Guard to install larger 

numbers of more sophisticated electronic equipment 
aboard its newly designed vessels. 

A. BUDGET AND PERSONNEL 

This chapter presents the budget limitations the Coast 
Guard has in developing major electronics systems. Specific 
program elements within the Navy budget are presented to 
Show the high cost of developing electronic systems in areas 
which effect many Coast Guard missions. Also discussed in 
this chapter is the trend of installing a larger number of 
military systems on the newer Coast Guard platforms. Finally, 
a brief discussion as to why the Navy furnishes the Coast 
Guard with military systems is presented. 

Increasing costs of electronic surveillance equipment is 
a major factor that the Coast Guard should not ignore. Budget 
and personnel constraints severely limit the amount of funds 
available for independent research and development or 


production of sensor systems. These limitations apply to 
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equipments for existing class vessels as well as newly 
designed cutters. 

The amount of funds and personnel associated with 
research and development efforts in the Coast Guard is small 
comparison to that of the Navy. The total Coast Guard 
request for research and development funds in 1976, excluding 
mite transition quarter, was 20.7 million dollars. This 
ficure represents Only 1.9 percent of the total budget 
request for the Coast Guard. In addition to this relatively 
small request for funds, only five tenths of one percent of 
total Coast Guard personnel (military and civilian) were 
engaged in the RDI and E program. The U.S. Navy, however, 
spends a much larger portion of its budget in the RDT and E 
sector. In 1976 the total obligation authority for the Navy 
under the appropriations title of RDT and E was 3.314 billion 
dollars. This represents 11.5 percent of the total Navy 
budget, and was approximately three times the entire Coast 
Muara budget. Since 1973 this trend for allocating roughly 
eto 12 percent ok the Navy budget for RDT and E has 
remained constant.” While no direct comparison of the Coast 
Guard and Navy RDT and E budgets should be made, certain 


program elements within the Navy budget can be used to depict 


‘Department of Transportation and Related Agencies 
Appropriations for 1976, Hearings before a Subcommittee of 
Amer Committee On Appropriations, H.R., 94th Congress, First 
mession, Part 1, 1976, p. 82. 


united States Navy, Chief of Naval Operations, Historical 
Eudset Data, March 1977, p. 60. 
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ico ro deve loping electronic sensor systems which 
BEemapplicaple to the Coast Guard. In 1976 the U.S. Navy 
requested 53.8 million dollars for program element 62702E, 
tetical technology. This program element includes target 
Bess roussidenti:icatıon, and ocean monitoring and control. 
The Navy further requested an additional fourteen million 
es klars fOr program element 62708E, advanced ce technology.” 

Systems developed by the Navy in these program elements 
will become increasingly important as the Coast Guard assumes 
increasing responsibilities of ocean surveillance and 
monitoring in the fields of law enforcement, environmental 
protection, fisheries patrols and military preparedness. 

The 1976 Coast Guard RDT and E request has been divided 
Mo its major elements to further exemplify tne limited 
funds available to the Coast Guard for developing systems 


wwa independent basis. All figures are in millions of 





SC EE 
toca tonto: Coast Guard RUT and E Funds 
Search and Rescue E! 
Aids to Navigation 150 
Marine Safety IÓ 
Marine Environmental 9.01 
Protection 

Ocean Operations 0.15 
Program@oupport 4.50 

20.66 


Hearings on Military Procurement. 


Department ci ns portaron) Hearinmgs, p. 82. 
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Coupled with the phenomenon of the limited funds available 
for developing sophisticated electronics systems is the Coast 
Guard's policy on how RDT and E funds should be expended. 

As in the past, our aim is to apply the 
benefits of science and technology to Coast 
Guard missions and operations in order to 
reduce costs as well as improve services to 
the public. 

In order to improve services to the public the greatest 
amount of funds must undoubtedly be devoted to peacetime 
missions and operation. However, in the case of existing 
eners, the selection of military systems from Naval 
inventory which have the largest peacetime benefits and 


perform the required military missions is also compatible 


with the goal of improving services to the public. 


Pee MILITARY SYSTEMS TREND 

The trend of the Coast Guard to install a large number 
of sophisticated systems aboard newly designed cutters also 
increases the importance of properly evaluating Navy systems. 
A comparison of the installed major electronic and weapons 
Systems aboard the newest existing cutters with planned 
Eauipments tor the proposed 270 foot MEC shows this trend. 

Meco asia uara Seo/7S toot high endurance cutter (HEC) 
has been chosen as representative class of existing cutters. 
This class vessel was selected as it represents the newest 
alter in 1ts respective class. This class cutter also 
represents the vessel which would be the most compatible 


in augmenting military multi-unit naval exercises. 


Tide pa Se. 


Joy 





The 378 foot HEC's were first commissioned in 1967 and 
the following equipments represent the standard equipments 
presently aboard most vessels in this class vessels. The 
o suce dan on board ASW system. This system is 
composed of the SQA-38 sonar system which is coupled with 
NIT Lire control system"to direct MK-32 torpedos. Surface 
RINA adas consist) Of the SPS-29 and SPS-51. To complete 
the systems suite installed is the MK-56 gun fire control 
system which directs the five-inch mount on board.’ Me 
above equipment systems indicate that the major military 
mission of the 378 is anti-submarine warfare. While military 
coastal surveillance and surface search can be adequately 
Carried out, present armament and electronic systems limit 
this class vessel's effectiveness against incoming aircraft 
Or missile threats. 

The new 270 foot MEC, because of improvements and 
additions of equipments systems, has the capability to 
Soa orm a greater number of military missions, while at a 
much reduced manning level. ASW capabilities will be 
performed under the ship-helo team concept. Current plans 
provide for the capability of deploying a LAMPS helicopter 
to be used in conjunction witha passive tactical towed array 
SOnar onboard the MEC. In addition the MEC will be provided 


mee MK-92 fire control system used in conjunction with a 


Janes Eine Snips 1976-77. 


ES 





revised version of the OTO-Melara 76mm guns.® Also, an 
electronics system module (ESM) will be installed to provide 
the capability of anti-missile defense. Finally, complementing 
the installed equipments, space-weight reservations have 
been made to allow the installation of the Phalanx close in 
Memos sis tems, Of its equivalent, and the Harpoon missile, 
been Of Which are planned for availability in the mid 1980's.” 
inewoucarcrummumnchs or ClEeCtronie systems on board the 
270 fcot MEC have not only expanded the military mission 
capabilities of this class vessel, but also have increased 
aer potential capabilities of performing various peacetime 
missions. Major tasks of peacetime missions expected to 
benefit from these systems are air, surface, and underwater 
Surveillance, navigation, and communications. Indeed, there 
mameuwrrently arm R&D study underway to establish the modifica- 
Bons required for the ESM package to previde a law enforce- 
ment capability.*” 
The discussion has been limited to establishing the need 
ene Coast Guara to evaluate Naval systems. It should also 
Memmentiloned that the Navy has much to gain from joint 
@eenpeGation with the Coast Guard. The major benefit derived 


for the Navy is the additional immediately available surface 


Meeattorms and trained personnel that the Coast Guard could 


Moore, p. 22-24. 


“Tbid., p. 22. 


1 Tpid., p. 22. 
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provide in times of actual hostilities. However, the actual 
benefit derived from the Coast Guard vessels will be largely 
dependent on the equipment on board these vessels prior to 
the beginnings of hostilities. Refitting of equipments and 
the re-training of personnel on board Coast Guard vessels 
could greatly reduce the effectiveness of the additional 
Coast Guard vessels duringthe most critical early period 
Sreany short conflict. Thus it is also in the Navy's 
interest to ensure that the Coast Guard has sufficient 
quantities of high quality equipment aboard its vessels. 
Thus, given that increased military capabilities will be 
required of future and current class cutters, the question 
remains as to how one selects the equipment system that 
provides the greatest peacetime benefits. One problem of 
Be em Selection for hte Coast Guard is that Te best piece 
of equipment for the Navy does not guarantee that it will 
also be optimal for the Coast Guard. Indeed, there may be 
several competing systems all capable of adequately performing 
the military missions agreed upon by the Navy and Coast Guard. 
pomever, each may have unique characteristics that benefit 
different peacetime mission areas. The extent of this 
problem becomes even more evident when the competing systems 
are of a dissimilar nature. Such would be the case when 
trying to compare systems such as sonars, towed arrays, and 
ASE tro Optics, in terms of their overall impact on peace- 
mime MiSsions, assuming all are capable of performing the 


military mission of underwater surveillance. 
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The proposed cost-benefit methodology presented in the 
remainder of the paper attempts to deal with the problem of 
Poe ieeselcecelon. AS it becomes increasingly difficult to 
eboosessystems based solely on stated operating character- 
istics, the proposed methodology based on using subjective 
judgements of experts to measure benefits, becomes a useful 


tool tor the analyst. 





MACU CONS T DERATTONS OF SYSTEM SELECTION 


EE tere ee the identification of 
relevant cost elements 1S important in developing meaningful 
estimates of a system's cost. The high degree of uncertainty 
M total research and development and also procurement cost 
elements for proposed systems often make total-dollar cost 
ee mates highly variable. This variability of the cost 
estimate often masks the importance of conducting detailed 
analysis Ot the cost elements associated with operating 
ass. When considering the selection of existing equipments 

' 
from Naval inventory, the uncertainty of all cost elements 


IP ca uc cda Tnhus-ıtrt becomes even more important to identify 


relevant cost elements. 


Pee JOINT SERVICE AGREEMENT 

This chapter identifies the relevant cost elements to 
the Coast Guard when considering military equipments from 
Naval inventory. The joint-service agreement between the 
Navy and the Coast Guard allows the Coast Guard to acquire 
pads Operate military equipments at a much lower cost than 
if the Coast Guard had developed the system independently. 
mo developed is a life-cycle cost equation to be used in 
Secimating the dollar cost of alternative systems. 

The joint-service agreement prcvides a detailed 
description of the cost elements applicable to the Coast 


Guard when selecting military equipments from Naval 


IN 
IN 





inventory. The underlying concept of allowing the Coast 
Guard to select equipments from Naval inventories is stated 
in the following general provisions of the joint-service 
Armeement. 
To ensure the ready integration of the Coast 
Guard units into the Navy in time of war or 
other emergency as approved by the President of 
enesbnmted states, the Chief of Naval Operations 
shall provide to the Coast Guard all requirements 
for Navy-owned military readiness equipment and 
associated support material that the Navy deems 
necessary to enable the Coast Guard or specific 
Cods e mard units tO carry out assigned missions 
while operating with the Navy... 

Further examination of the joint-service agreement 
demonstrated that cost elements of research and development 
and production are not relevant to the Coast Guard's cost 
estimate. Research and development and also production 
@ests are porne entirely by the Navy. Table I presents the 
allocation of cost elements applicable to each service as 
Stated in the joint-service agreement. 7 


Ir anmecnesın:ormar1ıon or Table I indicates that 


mre typical life-cycle cost estimating function 


Cost = f(Research Development, Production, Operation) 


Bmot applicable for the Coast Guard. The Coast Guard's 
Stated cost elements indicate that a more appropriate 


relevant life-cycle cost equation is 


Cost = f(Operation) 


Nav. Bere ruet1one.H200.18 98: 20 October 1969, p. 5. 


od. 
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CN 


TABLE I 


ALLOCATION OF COST ELEMENTS AMONG SERVICES 


Initial issue of all basic equipment for 
installation 


Related repair parts, assemblies, field changes, 
test equipment, special tools, and accessories 


Scheduled replacement of Navy owned equipment 
Replacement of defective Navy owned equipment 


Maintenance support material and services for 
installed equipment 


Kog e tiee supranti functions 


Reciuimeameand tactical publications 


feast Guard 


Transportation and installation costs 


Spares and repair parts peculiar to Coast Guard 
vessels 


* 
Annual cost of maintenance support material 


SEET basis to an 
agreed maximum limit. 
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Even many cost elements generally considered as operating 
costs are borne by the Navy. Items two thrcugh six assigned 
to the Navy in Table I are operating cost elements that 

should be removed from a Coast Guard cost analysis. Reducing 
life-cycle costs to a function of only operating costs does 
not eliminate all uncertainties in estimating Cost. However, 
po the problem of selecting equipments from Navy inventory, 
the systems personnel requirements ard equipment reliabilities 
have been established by the Navy. Thus, the major element 

of uncertainty in the cost estimate arises from transforming 


the known requirements into dollar values. 


PONS ECIPLED COST ELEMENTS 

While the stated cost elements assigned to the Coast 
Guard should be considered, cost elements not mentioned in 
we Jolnt-agreement are also important. These elements 
of cost are borne by the Coast Guard and represent a large 
percentage of the system's life-cycle cost estimate. 
Omitted cost elemerts which must also be considered in 
arriving at a meaningful estimate of a system's cost are 
tin manpower requirements, maintenance personnel, and 
their associated training costs. These cost elements, along 
with those identified applicable to the Coast Guard in 
Hable T, should be utilized when computing the estimate of 
Salen System's life-cycle cost. 

Having defined the cost elements that are included in 


the cost-benefit analysis of alternative systems, the elements 





Ie na rated into recurring and non-recurring costs. 
This procedure is required as life-cycle costing takes 
into account the actual flow of expenses over a system's 
lifetime by applying a present value analysis to the 
Eme cted cash low. ne present value concept applied to 
cash flows is an attempt to reflect the fact that a dollar 
expended today has a higher alternative opportunity value 
maan a dollar expended at a later date. Non-recurring cost 
ements are those costs that occur only once during a 
ot em's lifetime. Only transportation and initial instal- 
lation costs are considered non-recurring costs in the 
proposed analysis. Installation costs should also include 
costs for modifications to existing cutters required solely 
for the addition of the proposed systems. All other cost 
Becments are Classified as recurring costs. However, the 
Proposed cost-benefit model omits the maintenance and support 
material cost element. Elimination was deemed reasonable 
as the actual cost of this category is more dependent on 
management and accounting techniques within the Coast Guard 
than on the actual equipment chosen. Therefore, omitting 
this element assumes that proper management policies are 
being followed and that the Coast Guard properly documents 
and requests the correct amount of reimbursement necessary 
mea support. 
1. Estimating Dollar Ehe Costs 
As a result of the joint-service agreement and the 


Stated assumptions, the equation to determine relevant dollar 





Me le cos tes taimetes tor alternative weapons systems 


may be expressed as: 


j n 
= il 
Cost KS IL, + E > (O94 + Say d Mei] zu. 
=1 =l a) 
where indices: j = number of vessels for which the 


system is being considered 


n = time horizon in years 
ISO Uat factor 
variables: I = installation and transportation 
costs 
0 = life-cycles cost of operating 


personnel including training 


S = yearly costs of spare parts unique 
ton ene Coas tuGuard 


M = life-cycle cost of maintenance 
personnel including training. 


Due to the small number of vessels comprising each 
ieee S Class, the analyst often may have sufficient time to 
famine the problem of cost on a detailed level. However, 
if the analyst can only use average cost estimates for each 
of the variables, equation one may still be used. Care 
should be taken when calculating cost estimates on a detailed 
level for a single vessel and using this vessel as an average 
St estimate. Vessels of the same class often have unique 
equipments on board and great disparities of attached 
personnel. Thus, average cost estimates derived from a 


e te ship can be very misleading. To avoid this situation, 





it is suggested that when using average cost values they 
be obtained by averaging costs over all vessels in their 
mespective class. 

Obtaining estimates for the variables in equation 
one requires close cooperation with the Navy. Values for 
installation and yearly spare parts unique to Coast Guard 
vessels can only be determined after interface requirements 
are known. The actual determination of Coast Guard manpower 
requirements presents the most challenge to the analyst. 
However, once the manpower requirements have been determined, 
the analyst next applies the life-cycle dollar cost output 
trom the Navy billet cost model to obtain estimates of 
personnel cost. This method requires the assumption that 
Naval enlisted billet costs can be equated to Coast Guard 
enlisted billet costs for comparable rates. This assumption 
mould be omitted if life-cycle costs for Coast Guard 
Bullets are available. An excerpt of Navy life-cycle billet 
costs for 1972 is presented in Table II. This is presented 
to show the billet cost models disaggregation level of 
output and is used in the later example of determining 
a levant life-cycle costs. 

Actual dollar figures presented in Table II have 
been calculated to reflect total cost to the government of 
esitabilishing a military billet within a proposed system. 
mms, billet costs take into account base pay, training, 
transportation, and retirement costs of Bo 


LN ayy Maa annower Bullet Cost Data for Life-Cycle 
nan? Purposies, NAVPERS 15163, April 1972. 





TABLETTI 


ANNUAL ENLISTED MANPOWER BILLET COSTS FOR 
LIFE-CYCLE PLANNING14 


Rating E2 ES E4 ES E6 E7 ES ES 


Blectronie Tecehnıeian 
ET STEEN eet E 24,868 27,651 32,499 


Radarman 
RD BU oe oc commie ee Ek 22,440. 25,058 27,239 


Uam ter 
QM IAS 110897 12665 16,448 mm9 596223797 27,782 


~w anre manpower costs in this method is appropriate 

for the system selection problem under consideration. The 
ABE Ton ol military equipments on existing cutters requires 
mame mew billets be created. 

After having established the major cost elements of 
the proposed equation to determine dollar life-cycle cost 
estimates, an example of how to apply the proposed cost 
Paermiadeing technique 1S presented. Ali data is fictional 


Be ıllustrative purposes. 


re 





Example: 


System 1 
eystem 2 
System 3 


System 4 


The Coast Guard and Navy have agreed on air- 
search mission (military) to be performed by 
the 250 foot Coast Guard vessels. There are 
currently 4 active cutters in this class. 
The Navy has also furnished the Coast Guard 
with a list of 4 alternative air-search 
radars in their inventory which are capable 
of satisfactorily performing the military 
mission. 


The Navy further furnishes the Coast Guard 
with systems requirements of the four 


systems. Manpower requirements are presented 
in the following matrix format. 


Manpower Requirement Matrix 


Operators Required (RD's) Electronic Technician (ET's) 


ee E-O» E-/ ESO IESO MESS O ES 
l Z 1 2 1 
2 1 l it 2 
> 1 2 l 
2 l l 1 2 


In addition, the Navy also provides the Coast 
Guard with years of useful life of each system, 
and a meeting between Navy and Coast Guard 
engineers yielded the cost estimate for spare 
parts unique to Coast Guard vessels. This 
information is presented as follows: 





Maroma clon Matrix 


Mars te Spare Parts Installation 
System 1 8 0 130,000 
System 2 E 5,000 50,000 
System 3 20 0 75,000 
System 4 8 4,000 100,000 


olution: 


e Iranstorm the manpower requirement matrix into 
Memedes.  Ihis example, in keeping with the assumption of 
MOO percent utilization of present Coast Guard resources, 
assumes manpower requirements as presented by the Navy are 
proxy variables of Coast Guard manpower requirements for 
poem system. Thus, manpower costs per year are computed bv 
eebe the number of men in each rate by their respective 
IC ~elcmeostesetrom Table II. For the purpose of this 
example manpower requirements are considered constant for 
the life of the system. Equation one will allow these costs 
momwary if Manpower is expected to change over time. Dollar 
Mmoeower COSt estimates for the example problem are as 


follows: 





Yearly Manpower Costs 


Operating Maintenance Total 
System 1 02,512 54,147 115,459 
System 2 43,280 PURSES MS O 
System 3 39,526 TEI 103,043 
System 4 59,709 Ze ISLAS US 


De te mine the time horizon tor each alternative 
system. The Navy provides the Coast Guard with an expected 
system's remaining useful life for each of the alternative 
a ens. This, however, is not necessarily the. years of 
eeehe Coast Guara should use for planning purposes. The 
Mas tE Guard must also consider the expected life of the 
vessel prior to decommissioning. Thus, the time frame to be 


Br EE life cycle cost for each alternative is: 


Ei Eon oem Syseens lite, vessel life). 


mE ee near ronwassumes a vessel's expected lite 
a a teen years. Therefore, the time frame for each of 


ea systems is their original estimated life. 


MS: apply the life-cycle cost equation [EQ. 1] to each 
of the alternatives. To ensure all cost elements are 


meae ea eS Suggested that the following cost element 





MA be constructed. Inputs are the results of steps 


one and two as well as the original information matrix. 


Cost Element Matrix 


Time Horizon Installation Operators Maintenance Spares 


System 1 8 1507000 ES 54,147 0 
System 2 E 50,000 43,280 72,599 5000 
System 3 10 75,000 59,328 Ir 0 
System 4 8 100,000 59,709 72,599 4000 


Applying equation one to the above data yields the 
following life-cycle costs relating to each system being 


mastalled on all four vessels. 


Wirte Cycle Cos GaMatrix 


Lite Cycle Cost Systems Life Time 
System 1 ISO SS 8 
System 2 3,494,194 12 
System 5 28924595 10 
System 4 542082207 8 


Finally, one further assumption in the proposed method 
EE termine relevant life-cycle costs should be noted. A 
momo dollar cost is assigned to weight and space requirements 
of alternative systems. In the system selection problem 


for existing cutters, no meaningful dollar estimates are 


CN 
Li 





obtainable. If existing platforms can accommodate these 
systems and no other systems are planned for future installa- 
GE the assumption of a zero dollar cost is valid. 
externality Costs 
While no dollar value is assigned to the weight or 

space requirements of alternative systems, these require- 
ments should not be deleted when preparing the cost-benefit 
alysis. space and weight requirements should be treated 
As externality costs. These are costs associated with 
Ate rmative systems that cannot be expressed in a common 
denominator such as dollars. For many problems of choice, 
externality costs may be the determining factor for selecting 
an alternative. Thus, the importance of the analyst iden- 
Mn? externality costs cannot be over-emphasized. 

| Nosartemptzı emademeo list@mere ali externality 
Meee lements relevant to the Coast Guard's problem of 
systems selection. These must be identified each time a 
Mewealternative list 1S formulated by the Navy. However, 
Same ot the major externality costs, in addition to space 
weegt requirements, that appear to be common to most 
analyses of this nature are listed. These include the costs 
eo aated With restricted access to foreign ports because 
certain electronic equipments or weapons; the changing 
public image of the Coast Guard from a peacetime service 
to a more military-oriented service; and the overarming of 
a vessel to such a degree that no adequate weapons would 


De available in peacetime situations. Finally, one other 





item is handled as an externality cost in the proposed 
cost-benefit analysis. This is the cost of selecting 
equipments with unequal expected lifetimes. The proposed 
methodology to determine life-cycle costs does not attempt 
to compute an average life-cycle cost per year for each 
alternative. Thus, the decision-maker must consider both 
total life-cycle costs and the system's expected lifetimes 
when arriving at a final selection. Two alternative methods 
for handling unequal expected systems lifetimes were examined 
and considered less desirable. Both methods attempted to 
combine time and life-cycle cost estimates into a single- 
dimension estimate of cost per year. The first alternative 
method took the total iife-cycle cost estimate for each 
System and divided these values by their expected useful 
operating life. This method produced what is sometimes 
called an average cost per system. While it is appealing 

to present the decision-maker with directly comparable costs 
Ens tashion, the results can be misinterpreted. The 
rational decision-maker would be expected to choose the 
system with the least average cost if their benefits were 
equal as it can be assumed that the goal of the organization 
iS tO minimize total costs. The major disadvantage of this 
Procedure is the cost values obtained from the computation 
above are not reaily average cost values. The inciusion 

Gi the present value concept in equation one implies that 
qual dollar expenditures over time are assigned different 


fees im the total cost estimate. Since dividing a total 





life-cycle cost estimate by the system's lifetime does not 
yield a valid average cost, minimizing this value does not 
euarantee that the true average cost is also minimized. 

The second alternative method to obtain comparable 
yearly cost estimates for alternative systems was to adjust 
all time horizons to the maximum expected lifetime of any 
single system. This included the expected life of the 
platform. Thus, if system's A and B had expected lifetimes 
ot 5 and 10 years, respectively, then it would be assumed 
Mat after 5 years an additional system A must be procured 
to complete the 10 year lifetime of system B. A decision 
of this nature is really a multi-stage decision, however. 
The outcome of a multi-stage decision is rarely realized 
wem l itary problems. This 15 due to the face that avail- 
able military systems and the decision-maker are constantly 
changing. It is more probable that at the end of system 
A's initial life time another analysis of alternative 
Penas will be conducted. After this analysis it is quite 
probable that system A will not be purchased. Because yearly 
Best estimates may be misleading to the decision-maker, no 
attempt has been made to quantify life-cycle costs and 


Systems' lifetimes into single numerical values. 





O e ONERA TEN OPF EXISTING MULTI-ATTRIBUTE 
TECHNTOUES 

Having established the cost of the alternative systems, 
whether by the proposed life-cycle costing technique or by 
other methods such as devising cost estimating relationships, 
the next problem is to establish the actual benefits of the 
systems. The exact measurement of peacetime benefits each 
system provides to existing cutters is a complex problen. 
Existing cutters have the responsibilities of performing 
several peacetime missions. Thus, a single vessel may be 
Peopectea tO perform missions such as search-and-rescue, 
enforcement of laws and treaties, marine environmental 
Protection, or any number of the designated Coast Guard 
peacetime missions. If the goal of the Coast Guard is to 
select the system with the greatest peacetime benefits, 
the systems must be evaluated in terms of their benefits to 
each mission. Once this information has been obtained, 
however, the question remains as to how the decision-maker 
Should select the best system. Since many missions comprise 
the peacetime responsibility of the cutter, one method of 
Merivine at a rational selection is to use multi-attribute 
decision theory. This chapter discusses the requirements 
MeeessSary tO utilize multi-attribute decision techniques as 
a decision-making aid. Discussed are the requirements 
necessary to perform any form of multi-attribute analysis. 


This discussion further examines specific requirements ot 





the more frequently used techniques of Dominance, Maximin, 


Maicao meo ry and the Additive function form. 


EN CONCEPT OE MULTT-ATTRIBUTE ANALYSIS 
The underlying concept of multi-attribute decision theory 
may be summarized as follows: 


Gene or alternative systems and the 
organizational goals, decompose the goals 
into a complete list of attributes and then 
attempt to measure each system's impact on 
each of the attributes. Next, establish a 
procedure that will reflect the decision- 
maker's preference of the relative importance 
Or edelmeot the attributes. Finally, obtain a 
decision-making rule that will select the 
System that obtains the highest value, or 
Utility, to the decision-maker based on his 


Stated preferences. 


ER. PROBLEMS 

mite the concepts of multi-attribute decision theory 
have strong intuitive appeal, there are several inherent 
Problems of utilizing a multi-attribute analysis for systems 
election. First to be discussed are problems common to 
all multi-attribute techniques. These problems may be 


Summarized in the following categories. 


oa ants on information processing 
MELOmeertainty 


* Data requirements 





EE EE On Information Processing 

One of the reasons for using multi-attribute 
Be er ron theory is the limited amount of data that a 
decision-maker can process and make a choice consistent 
with his subjective evaluation of the data. The underlying 
concept of multi-attribute decision theory is that the 
analyst should strive to reduce number of relevant variables 
the problem, referred to as the dimensionality of the 
problem, to a smaller dimensional problem the decision-maker 
can comfortably handle. Ideally, the decision-maker would 
Bere to Dase his decision of choice considering all attri- 
butes simultaneously. However, as the number of attributes 
increase, the decision-maker loses the ability to subjectively 
choose among alternatives. This phenomenon on the limitation 
of information processing has been studied for several years. 
Moe result of studies indicates that people can utilize no 
more than five to ten chunks of conceptual information at any 
given time.” 

DOrBE a e deei eon techniques rely on the 
underlying assumption that wholistic problems of choice can 
Mefdecomposed into the several smaller problems, each of 
which is simpler for the decision-maker to evaluate than the 
Aa repate problem. One of the necessary assumptions, there- 
meen is the goal of the decision process can be described 


memoletely by a finite number of attributes. This assumption 


Fischer, G.W., Four Methods for Assessing Multi- 
abate Utilities: An Experimental Validation, Technical 


Bement, University of Michigan, September 1972, p. 3-4. 
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seems plausible in studies involving systems selection 

since quite often an equipment can be characterized by 

either physical parameters such as weight, power requirements, 
etc., or by subjective values of broadly defined attributes 
that comprise the goal. Violations of the assumption of 
obtaining a complete list of attributes most often occur 
Mieneattempting to define the attributes of a psychological 
goal, such as measuring intelligence, where no agreed upon 
mest Of atrributes has been established. 

The second assumption brought about by the decom- 
weon principal necessary for most multi-attribute tech- 
niques is that attribute values are independent. Independence 
implies that the judges preference for m attributes are not 
influenced by the state of the remaining n-m attributes in 
the n dimensional problem. Independence requirements are 
the basis of most models used to describe multi-attribute 
decision making. Another implication of independence is 
Mea rement that mo Cross-product worth or other 
complementaries exists among any attributes. 

The exception to techniques requiring the indepen- 
dence assumption is a method known as effectiveness index 
theory. Effectiveness index models allow for the functional 
form of the value of system over all attributes to be any 
meena form. Cross-product terms or any functional form 
involving one or more attributes may be utilized to approxi- 
mate a judge's worth of a system. To use the effectiveness 


index model requires the analyst to be able to construct 
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Amo al Eo mM that approximates the decision-maker's 
subjective judgment. To accomplish this task the analyst 
Miomivo optıons. He may ask the decision-maker to specify 
mie tumctional torm that he used in arriving at the decision 
er he May attempt to arrive at a functional form of the 
decision-makers judgment process given only the judge's 
values of the attributes. If the analyst cannot arrive at 
the decision-maker's functional form, he has few options but 
E ome requirement Of independence among attributes. 
EE e aa oute decision techniques allow 
e analyst to select whatever dimensionality of the problem 
he wishes to consider when making his recommendations to the 
decision-maker. However, the assumptions required for tech- 
memes Usime full dimensionality in the decision criteria 
ge so restrictive that full dimensionality is of limited 
MAS most situations. Unfortunately, the reduction of 
mee original full dimension problem to a single attribute 
mammumetrical value does not simplify the problem of choice. 
Indeed, further assumptions are also required to base a 
eision on a single numeric value. These assumptions are 
discussed in the presentation of existing multi-attribute 
Metso techniques that require a single numeric value. 
Mmeemajyor disadvantage of utilizing a single numeric repre- 
Pem@eation Of an alternative's worth is not the acceptance 
of the required assumptions. Generally, these assumptions 
are necessary for the decision-maker to use an analysis and 


Ave at a rational choice. The problem is that often the 
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a nalen reguired are deemed valid by the analyst and 
not the decision-maker. These assumptions are then unknown 
Poste deeisson maker when he makes a rational choice from 
the prepared analysis. An analyst should strive to present 
the analysis to the decision-maker in the maximum dimensional 
Mere that the decision-maker Can utilize his expertise to 
E ive at rational choice. 
fee UN CE AAN 

Instant decision making process refers to 
NEE Eet Omer Ort selecting any alternative 
System. Most actual problems have some degree of uncertainty 
associated with them. Existing techniques, however, often 
Mean by assuming that the outcome is certain. This require- 
Mo certainty on the outcome space is necessary for 
Several reasons. the major technique utilized to reach a 
merce among alternative candidates that formally considers 
Mia stalnty 1S the expected utility principal. However, 
tene analyst to apply utility theory to actual problems 
Mio tcs requires severe assumptions. The expected utility 
Peelers le requires not only the existence of a utility func- 
meen, but also that the decision-maker is able to specify 
Peeeeooudbility distribution over the possible consequences 
Na SE TON laisercaquirement is difficult to fulfill 
em tual decision-making problems since often the decision- 
maker cannot establish all the possible outcomes of a decision. 
¡NS outcomes of each course of action are known to the 


Mimmiyst, Ne next must assign a probability to the outcomes 





cc inally a rule to combine the utilities across 
all attributes must be devised. 

If one is willing to make the assumption that a 
decision-maker can specify probability distributions over 
€dach of the possible outcomes, other problems arise in using 
the expected utility principle. One problem is determining 
what functional form the analyst should use when combining 
the various probabilities and utility values over all possible 
@utrcomes tO arrive at a single utility value for each alterna- 
mace Expected Utility principle requires that the expected 
Berlıty Of an action be an additive functional form repre- 


sented dE 


EU(A,) = WÉI U(x) d Paz U(x,) Dre: SCH U(x,) 
where 
EU Me EE EEN 
A. = eh action 
e = Probability of ae outcome with respec to 
¡Eh aetıon 
U(x;) —SeUtr lity Of outcome (X;) 


Feomeune (functional form EU(A;) to additive, it has 


Paommdenmenstrated that an additional assumption 1s necessary. 


en. 10. 





This is the assumption of marginality among gambles.*' 


The marginality requirement implies that if two finite 
gambles are marginally equivalent then the decision-maker 
must be indifferent between the gambles. Two gambles are 
marginally equivalent if they give rise to identical 
femeinal probability distributions. 


Thus, if one had a choice of the following two 


gambles 

Pmowapility “omer receiving a lOO percent 
MAS Ss sion lana a 75 percent increase 

Gy = i mission 2. 
Probability .5 of receiving a 10 percent 
increase in mission 3 and a 20 percent increase 
SS TOA 
POC o ya or receiving a 100 percent increase 
in mission 1 and a 20 percent increase in 

G, = mission 4. 


Bagpipe eso PeroGelVilng a 75 percent increase 
ss ton anar a LU percent increase in 
MiS EE 


Then for marginality to be present the decision-maker must 

be indifferent as to which of the gambles he selects. This 
I due to Gy and G, being marginally equivalent. However, 

wehe decision-maker prefers gamble G, Since it assures 


him of a high value outcome, then the additive form for 


“sil, o l-15. 
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SOM UP beres 15 NOL appropriate. Other functional 
nne aave been devised for the case in which the expected 
MA Asno rt valid due to the violation of the marginality 
requirement. For further discussion in this area the 
interested reader is referred to [Fischer]. 

TMe e amo ton Of Utility theory in decision 
makıne eöntext 15 the requirement that the decision-maker 
selects his decision based on maximizing his expected bene- 
fits. In many situations, however, the decision-maker may 
be risk-averse and selects the decision which does not 
Maximize his expected gains but minimizes his expected 
messes. Other forms of decision criteria have been observed 
and in one laboratory experiment, with subjects trained in 
mecainime Probabilities, 41 out of 64 subjects made decisions 
by some other technique than maximizing expected utility.?® 

3. Data 

iiemrasty prObMemsthar Inkluences all=-multi-attribute 
MmeetsiOn analysis is the problem of data. The analyst is 
maeeecd With two problems in dealing with data. First, the 
analyst must decide the type of data to collect and then he 
must transform the original data into comparable values 
Meross attributes. The actual multi-attribute decision rule 
he selects will determine the extent that the data must be 
iP omeepuilated. Certain decision criteria require only that 


miemdata be comparable within each attribute. However, these 


ala. EE Methods tor Measuring 
Utility, Technical Report, University of Washington, July 4, 
ISFA 
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Aten ta E is tmteticently restrictive as to be rarely 
useful. Other criteria require complete comparisons of 
EE EE In these situations physical 
characteristics must be transformed into values that lend 
themselves to comparison. Finally, otner decision criteria 
ouire that values across attributes be additive. Thus, 
ratio-scale values are required. The following discussion 
enc ended to help eae analyst in arriving at the proper 
mele mecessary to usé the various multi-attribute selection 
Beer La. Also presented are the properties each measurement 
cale possesses. 

a. Nominal Scale 

This technique represents the lowest form of 

Mmeasumement scales. This type of scale is produced when a 
meese 1S asked to place items in Similar groupings based on 
any desired property. The final groupings have no order of 
worth, however. Nominal scales have the undesirable feature 
that statistical techniques depending on a distance between 
Peres concept, such as the mean, median, or standard devia- 
tion cannot be utilized. Nominal scales require only that 
Beh item 1n the same group be assigned the same number and 
that no two groups receive the same number. As such, any 
wo one transformation on the original data is permitted 
memwill preserve the groupings. For multi-attribute analysis 
data obtained on a nominal scale is of limited value. This 
Memaue to the fact that there is no method to combine values 


Se attributes. For single attribute problems, nominal 
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scaling techniques do have some advantageous properties. 
Statistics based on frequencies, modes, and coefficients of 
Son tinulty can be calculated from nominally scaled data.” 
Meme importantly, however, is the fact that this type of 
scaling requires the least amount of work for the judges 
scaling the alternatives. The judge is not required to give 
a numerical value of an alternative's worth but only to 
Peace items in groupings. 
be) Ordimal Scale 

Unlike the nominal scale, data obtained on an 
ordinal scale implies a difference of worth exists among 
groupings. Most often ordinal scale data are obtained by 
having judges rank order alternatives via some parameter 
property. Ordinal scaling allows the analyst to differ- 
entiate among equality, greater than, or less than among 
alternatives. As such, any monotone increasing transforma- 
Born 15 allowable on the original data as it preserves order 
Within the alternatives. Ordinal scaling is a popular method 
mor Obtaining information from judges as it requires the 
judges to simply rank order alternatives. Obtaining original 
Gata does not require the judges to assign any numerical 
male to the difference in worths among alternatives. 
wener, popularity of ordinal scales is increased by the 
zact that many procedures exist of a non-parametric nature 
allowing for the differences among alternatives to be 


obtained without assuming a normal distribution on judges 


+I ouilford, EE Methods, p- 8-19. 
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responses. The major disadvantage of ordinal scales is that 
no absolute value of the difference in worth among alterna- 
mepes ts possible. ~Also no procedure exists to combine 
ordinal data across attributes. Thus, while methods are 
available to compute the overall rank order of alternatives 
based on several judges' responses within a single attribute, 
There is no way to determine how much better the "best" 
alternative is from the second best or even the worst. From 
ecost-benefit approach this procedure is of limited use 
Ace. the amount of difference in equipment's worth is 
A essary to perform a tradeoff analysis between alternatives. 
Cae bom sca Les 

The third level on wnich data may be obtained is 
Mac interval scale. Interval scales are commonly referred 
to as equal-unit scales and have important properties over 
@euh the nominal and ordinal scales. The major property of 
Meerval scaling is that numerically equal distances stand 
momecdual distances in some aspects of the alternatives 


E E SUE oO canas property, two items 


being scaled.“ 
that have numbers 10 and 20 assigned to them are as far 
meert aS two items having the numbers 50 and 60. The 
meeeperty Of equal distance arises from the fact that 
interval scales have an arbitrary origin and arbitrary units 


which are constant over the scale. Since the origin and 


units on an interval scale are arbitrary, any linear 


5 
mtbr, p14. 
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transformation may be applied of the form x' = a + bx, 

where x denotes original value, a is a constant, and b is 

a scalar greater than zero. However, since the origin is 

arbitrary, little meaning may be attached to addition 

across attributes of numbers obtained on an interval scale. 
Common forms of data obtained on an interval scale are 

temperature measurement, altitude, and calendar time. While 

direct addition of numbers on interval scales is not permitted, 

actual distances measured between two values do have the 

additive property. This allows for almost all statistical 

meocedures to be performed on interval scale values within 

an attribute. These include calculating the analysis of 

variance, means, and the standard deviation. The one 

statistical procedure not allowed is the computation of the 

coefficient of variation, which is based on the ratio of 

the standard deviation to the mean of the distribution. 

This ratio is not meaningful since it depends on where the 

Mebitrary zero point is located. - 
While interval scaling procedures have far more 

use to the analyst than either nominal or ordinal scales 

it must be noted that the requirements on the judges have 

been greatly increased. No longer is it sufficient for the 

judge to group or rank alternatives. The judge is required 

tO actually assign a numerical value to the alternatives in 


a consistent way. 


? 
oa p. 15. 
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de FrReaulowocale 

The last measurement technique available to 
the analyst is the ratio scale. Ratio scales occur in data 
where there 1s a fixed or natural origin. Examples of 
ratio scales are length, cost and time with a fixed 0 point. 
mee tro scales nave an absolute zero point, it is possi- 
Mts GOmequate meaningful ratilos on the number sgale. This 
implies that not only all previously mentioned statistics 
may be calculated on ratio scale values, but also the 
MBeetticient oí variation may be computed. Values computed 
from ratio scale data may be compared for equality, inequal- 
meee equality of raios of intervals and equality of ratios 
themselves. The original data may be transformed by the 
mer ot any equation in the form x' = bx, where b is a scalar 
greater than zero. 

While ratio scales are the most powerful in 
terms of the number of statistics that may be calculated, 
this scaling method requires the analyst to use ratio 
scales on subjective judgments. To obtain ratio scales 
meee judce must perform the task of expressing alternatives 
epee in terms Of ratios. As the number of alternatives 
requiring scaling increases it is quite common to observe 
maeonsistencies in values the judges assign to alternatives. 
eamce both addition and multiplication may be performed on 
Maelo scales, however, the ratio scale is very popular in 
analysis where a natural zero origin exists and the number 


Of alternatives to be examined is small. 
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Summarizing the discussion on scaling methods 
available to the analyst, as one progresses from nominal 
to ratio scales the amount of data manipulation permissible 
increases and the scales become more robust in the number 
statistics that may be calculated. Tempering the analyst 
wehe proper scale to utilize, however, is stated require- 
ments of each scale as well as the increasing requirements 
en the judges’ response level. Equally important as selecting 
M proper scaling method is the assurance that the limita- 
tions of the chosen scaling method are followed. Often 
many limitations are violated in the attempt to obtain more 
information from data than the scaling methods allow. An 
example is attempting to obtain interval scale data from 
enk orderings by Judges. Arbitrary values are often 
meerened tor various ranked positions, 1.e., 10 for the 
item ranked first, 9 for second, down to 0 for the lowest 
aked alternative. Finally, an average value is computed 
ward on tne number Of points acquired. The deficiency 
NS procedures that the results often depend on the 
Beottrary numerical values assigned to the rank-ordered 
Bn Therefore, when addition of values across attributes 
is required the analyst must realize the values must be 


Motained on a ratio scale level. 


> 


— 


7 
“Moon, J.W., "A Problem on Rankings by Committees", 
meonometrica, Vol. 44, 1976, 
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fee COMMON TECHNIQUES UNDER CERTAINTY 

After having discussed the problems of uncertainty, 
information processing capability, and data gathering 
Bricearrece all multi-attribute decision techniques, the 
Memainder ot this chapter will be devoted to examining 
ee less decision criteria. Even riskless multi-attribute 
techniques require many assumptions that are difficult to 
verify in actual problems. Since they require fewer assump- 
tions than methods incorporating risk, analysts frequently 
Mee one or even several riskless techniques to arrive at 
their recommendations. Appendix D presents the multi- 
MN toute decision making techniques that are available 
to the analyst. The following discussion presents an over- 
view of the most frequently used techniques. Discussed 
meee the inherent assumptions and limitations that each 
meneri on exhibits. Techniques under discussion include 
Dominance, Minimax and Maximin, Lexicography, and additive 
weighting. 


i. Dominance Theory 





Dominance theory is one of the few techniques 
avallable to the analyst that may yield a solution to the 
eeen prooem by utilizing a decision criterion for 
mewection that considers all the original attributes. The 
decision criterion of dominance theory may be stated as 


Follows: 
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Let 


| >< 


(X1 >X2>X3> EEEE) 


and 


L = (Y 1Y 2Y 3> FO oad 


STA and Y demote the overall worth of alternatives X 
and Y, and (4 + X2X3> DE x) and (Y1>Y2>Y3> u vou 
denote vectors representing values of the alternatives 
over the n attributes for X and Y respectively. Then the 
decision rule may be stated as: 


Choose X a X tOr all i 


| v 
= 


or 
Y 1 


Dee 2 aomsculezarlowsng tor Ene > Or is termed 
a weak dominance decision. This implies the decision was 
made to select one alternative even though over some attri- 
res the system not selected was equal to the alternative 
Geseent If the decision rule uses only strict inequalities 
Br metcne=sdeeisionerule is Known as strong or strict dominance. 
Io ala be noted that this decision criteria is invariant 
as to whether the attribute values were measured on ordinal, 


meerval, OF ratio scales. Since many of the problems 





associated with data have been eliminated, dominance is 
one of the most easily applied decision criteria. Also, 
a decision based on the dominance decision rule can be 
regarded as a very rational decision. 

While dominance theory is easy to apply and the 
results are known to be good, rarely will the dominance 
criterion yield a solution to the selection problem. The 
Best that can usually be hoped for in utilizing the dominance 
decision criterion is the elimination of some alternative 
systems from consideration. Dominance will not solve the 
Mob lem or how to evaluate the remaining alternatives 
where dominance does not prevail. 

a een ques for assessing multi- 
tute decision problems reduce the original dimension- 
ality to a single dimensional problem in the attribute 
space. Minimax and maximin are the two decision criteria 
applied to multi-attribute analysis that have their origin 
from game theory. Because these two procedures require 
Many common assumptions to produce a decision rule, they 
will be examined together. 

2. Minimax and Maximin 

The minimax decision rule criterion requires that 
alternative values across attributes be highly comparable. 
If comparable values can be achieved, the minimax procedure 
e O first Obtain the maximum values of the alternatives 
Over all attributes and then select the alternative with 


the smallest maximum value over all its attributes. The 


54 





maximin procedure is to obtain the minimum values of the 
alternatives over all attributes and then select the 
alternative with the largest minimum value over all attributes. 

While minimax and maximin decision criteria were 
first introduced in game theory, their results should not 
be interpreted in classical game theory context. Game 
mt Ome requires trat a payott matrix be established. The 
Baz e or the payoff matrix is dependent on the number of 
courses of action available to each of the players. In 
decision theory contexts one can view the game with the 
decision-maker as one player and nature as the opposing 
player. However, the original m alternatives to be examined 
and the n attributes over which each alternative must be 
evaluated should not be considered a payoff matrix. Nor 
can a payoff matrix be established unless one knows all of 
ene different courses of action that nature may follow. 
Without have a payoff matrix established, the rules of game 
theory that ensure a player can follow either a pure or 
mixed strategy and maximize his expected gains, or minimize 
his losses, cannot be applied. 

Examining the minimax decision rule for multi- 
attribute analysis one sees that much information is not 
used in arriving at a decision. The only value compared 
among alternatives is the maximum value each alternative 
receives. Thus, the decision criteria often allows a system 


to be chosen where alternative systems may receive higher 
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values in the remaining n-l attributes. The same restrictive 
opero) disco holds true Tor the maxımin technique. 
E EOS PI 

Lexicography is another multi-attribute decision 
Criterion that may be regarded as a single dimensional 
technique. This decision criterion requires that the list 
of attributes be rank-ordered in terms of their importance. 
Next, the values of each alternative system is measured 
over each of its attributes. Finally, the decision criterion 
may be summarized as follows. Beginning with tne highest 
ranked attribute, select the alternative with the highest 
value in this attribute. If two or more alternatives have 
the same value in the highest ranked attribute, omit all 
Other alternatives with lesser values. Then proceed to the 
attribute list and select the attribute ranked second nighest. 
emane the remaining alternatives and select the alternative 
with the highest value in this attribute. If ties continue 
Memexist, the procedure is repeated, each time omitting 
alternative systems with values less than the maximum value 
of alternatives that remain, until an attribute is reached 
where only one alternative has a maximum value. If all n 
attributes have been examined and ties exist, the decision- 
maker should be indifferent as to which system is selected. 
An example is presented to clarify this decision criteria: 

Suppose one must choose a system to 

perno cia: surveillance and has a 


ers Eger three attributes to consider. 
Further the weight of importance of 





the three attributes are .2, .3, .5 
respectively. This information may 
be displayed in the following matrix: 


attribute 
J 
(23 (O) es 

Ll 2 3 

J High 6 2 

2 Low 8 8 

alterna- 

tive 1 3 Medium 4 6 
4 High 2 8 


Further let x.. entries in the above 
matrix denote thé value of the ith 
altemiative im the j | attribute where 
númerical values are on an interval 
scale. Then lexicography decision 
Ste on begins Dy selecting attri- 
bute three and examining the alterna- 
Poco oran cae Macsimum value, In 
this example alternatives two and four 
arestied witn a Value of eight. Elim- 
Poste aeernatıwes One and three from 
consideration and proceed to the next 
Dos MipO meditate ri bute, attribute 
two. Examining alternatives two and 
anne tome fe nas that alternative two 
meenen enesti value for attribute 
two. Thus the selection process stops 
e e C Oera phie decision Criterion 
SelceGesmalterlative two as the best 
system. 


The presented example demonstrates the advantage of 
using lexicography. The advantage is that no requirements 
op laced on the analyst to obtain values that are com- 
parable across attributes. Any form of data may also be 


zed that Exhibits the property of conveying a concept 


Of worth. However to obtain the characteristic of non-comparisons 


SE 





across attributes the analyst relies on a fundamental 
Bssumpciom. This assumption is that after the solution to 
an n-dimensional problem has been obtained by examining m 
attributes, the remaining n-m attributes have no influence 
Sethe Solution outcome. This implies that the original 
mike Or adturi@pbuces not only implies order, but also that 
each successive rank-ordered attribute is of such importance 
RON tie decision-maker that all other attributes with a 
Messer welght need not be considered when selecting a system. 
Mees tne Lexicographic decision criterion guarantees a 
selection outcome, much information about the various 
mpecTMatives 1S not utilized. 
4. Additive Value Function 

The final multi-attribute decision technique to 
be discussed is the additive value function criterion. 
Mais technique assumes that the alternatives may be eval- 
Mealted Over each of the attributes and then the worth of each 
alternative may be obtained by summing the alternative 
Æ lues across attributes. 

Ee the additive value function decision 
mercerion 1S that the final alternative value De BEER ENES 


merecighited average of the contribution the alternative 


29 


telas over the attributes. This technique has an advan- 


eet eovet Lice previously discussed decision criteria since 


¢3MacCrimmon, Bee ersten NMakıne Among Multiple- 
Attribute Alternatives - A Survey and Consolidated Report, 
Buero December, 1968. %P. 28-33, 
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each alternative is compared over all n attributes. This 
implies that no information was lost in arriving at a deci- 
Sion. Again, however, there are assumptions that the 
enalyst should Consider before applying the additive value 
munetion decision criterion. 

The first assumptions that the analyst must justify 
is that an additive value function is the correct decision 
Criterion. In riskless decisions the necessary and suffi- 
cient conditions that guarantee the existence of an additive 


evaluation function for three or more attributes en 


l. Preferences must be weakly ordered 


2. Monotonicity of attributes 


To ensure that preferences are weakly ordered the 
following two properties must be examined. First the 
analyst must be able to express all values in the following 
manner. Either he is indifferent, between two outcomes X; 
and SÉ ne prefers = to x, or he preters outcome x, to 
me Secondly, transitivity must exist between outcomes. 


Bransivity requires that for any outcomes: if 


x; 1s preferred to = and Es 1s preferred to Xp Pen x; 


must be preferred to XE 


+ Fisher, DIS 


SÉ 





onore emee attributes 1S more difficult to 
establish. To satisfy the monotonicity requirement it 
must be true that preferential independence conditions are 
satisfied among attributes. This independence assumption 
may be stated as: 

Let (Xj 5X5> Lee x) denote the attribute vector 
describing the worth of system X. Further, let Y denote 
any subset of these attributes and Y' denote the remaining 
Miaemabutes. Thus X = (Y, Y'). Now let Y; and SÉ be any 
two states of the Y attributes and let Y; and R be any 
mO states Of the Y' attributes. Then it must be true that 
the decision-maker will prefer the outcome (Y., Za if 
and only if he prefers (Y; > SÉ CG Liz: Se? 

The above independence or separability assumption 
implies that if one were examining the various alternatives' 
werall worth, the tradeoff values for attributes X] and 
X); keeping the other levels of the remaining attributes 
ked, does not depend on the particular values of the fixed 
levels. If both the preferential independence assumption 
holds along with the weak ordering assumption then this 
guarantees the existence of an additive value function for 
meskless decisions. 

Once the analyst has selected the additive value 


Me tion as the correct decision criteria there are other 


la. 
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requirements necessary to use the proposed cost-benefit 
model. First, the analyst must be able to obtain values 
Mea lternatrvesattribute matrix that are highly com- 
parable across attributes. Secondly, the values obtained 
must possess the property of additivity. Since only ratio 
scale values possess this property of additivity, the analyst 
is forced to use ratio scale values. The implication of 
ME ratio scale numbers is that values in the alternative- 
attribute matrix represents the decision-makers subjective 
Soluation of an alternative's worth for an attribute. 

Thus, if one system had a value of 3.0 in an attribute and 
another system had 6.0 in the same attribute, the second 
system 1s twice as valuable in the performance of the 
attribute. 

As can be seen, all multi-attribute selection 
Criteria require many assumptions that rarely can be veri- 
ee Valid in actual problems of choice. One problem 
of multi-attribute selection criteria is that no method has 
any internal checks that would indicate assumptions were 
clearly violated. Perhaps the best check that can be 
applied is to perform several different analyses each based 
Smeditferent assumptions. If the various studies all indi- 
cate the same alternative is best, this should indicate 
that the system selected is highly independent of the 
assumptions used to arrive at the decision. The proposed 
cost-benefit model was developed to be used in conjunction 


With NOSC's methodology to serve this purpose. In the 
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next chapter a discussion of how expert judgment may be 
used to estimate the overall ratio-worth's of alternative 
systems is presented. The procedure to estimate the 
alternatives ratio-worth's is developed for the case 
where the additive functional form has been deemed 


appropriate. 





V. METHODOLOGY TO OBTAIN ESTIMATES OF EQUIPMENT RATIO WORTH 


To measure the benefits of alternative systems from 
Naval inventory a method comprised of several previously 
discussed multi-attribute decision techniques is proposed. 
Combining the expected benefits measured in this chapter 
With the previously discussed relevant life-cycle cost 
matrix yields a four-dimensional solution to aid the decision- 
Maker in arriving at a rational choice. A four dimensional 
solution is proposed as it reduces the dimensionality of 
the original problem to a level the decision-maker may 
Pubjectively evaluate. This solution allows the 
decision-maker to use his expertise when arriving at 
decision as to which system to select. A technique of 
this nature eliminates the requirement on the analyst to 
formulate an approximation to the decision-maker's functional 
form he uses to tradeoff such diverse items as externality 
costs and a system's benefit. It should be noted that this 
procedure does not eliminate the requirement of performing 
Meese tradeoffs. This procedure is intended to aid the 
decision-maker by presenting relevant information required 
to perform this task. What it does eliminate is having 
to matnematically formulate the subjective process that 
the decision-maker uses. 

This chapter proposes the constant-sum method to arrive 


at an estimate of the alternative's worth. A least squares 





derivation of the constant-sum method is presented with 
emphasis placed on special cases that must be considered 
when using the constant-sum method to compare dissimilar 
aer nativos Pinalily, discussed in this chapter are the 
eeimtons the analyst has in interpreting the results. 

The methodology to measure benefits was constructed 
for the case where the Coast Guard has incomplete knowledge 
Of the alternative systems in Naval inventory and cannot 
make ratio judgements between all alternatives. Also, it 
has been assumed that the Navy is insufficiently familiar 
eith actual requirements of Coast Guard peacetime missions 
to make ratio judgements of the system's impact on each 
mission. However, it is assumed that expert judges do 
exist within the Navy to evaluate alternative systems in 
each of the attributes. Possible sources of expert judges 
include personnel attached to Navy laboratories who are 
considered experts in the fields of equipments under con- 
sideration, or personnel on board vessels who have had 
direct experience operating several of the equipments. 

Secondly, it is assumed that the ship-work-breakdown 
memettons which will comprise the attribute list describing 
Coast Guard missions are performed in the same manner by the 
Navy. A representative list of these attributes are presented 
Pmemyooemidix ©. specific definitions of attributes should 
Bewutilized in obtaining subjective values from different 
judges to reduce the variability in judges responses arising 


from personal interpretation of the various attributes. 
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A. METHODOLOGY 

To obtain ratio scale values of equipments’ worth based 
On Subjective judgement, a constant-sum method has been 
adopted from the psychological sciences. The basic assump- 
mon of this technique is that judges are capable of expressing 
the value of two competing alternatives in ratio form and 
Were exists a concept ot a natural origin among judges. 
Pimaereement on the natural origin in the case of systems 
eomparısons implies that the judges have the same concept 
of when the equipment provides no worth in a given attribute 
meemernat this Origin is constant over attributes. 

A discussion of how the constant-sum method may be 
utilized to obtain an estimate of the equipments' worth for 
Mictmeaqactripbute 15 présemted. For the system selection 
Brobsrem under consideration 100 total points has been chosen 
Ae values trat tne judges are tO divide within pairs of 
MaeeetMatives tor each attribute. In this discussion the 


following notation will be utilized. 


Let 
5 Ach 

ay = Abe n rot po lntstavarded to the ] th 

J alternative when compared to the i 

alternative, 1 # j 

KEE Number of judges responding oy IM 

J comparison of the j*™ versus it" alternative 
n = Number of alternatives to be compared. 


einen uds eras Splitting of 100 points between 


Zu serve Pairs Of alternatives may be presented in the 
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A matrix. The total number of comparisons each judge is 


required to make is an for each attribute. 


AsMatrix 
Alternative 
1 2 5 IO n 
er SE m 
é a3) SE SC Zë 
Alternatives 
I aal 422 “03 “nn 


The A matrix above for each judge is then combined 


to form an average value matrix. Denote this matrix A. 


h 


Let @,, denote the Gt entry in the A matrix. Then 


y may be computed by: 


avers = u wal? = 
J E 
judges 


nce E Nerresents tene raverace value of Alternative j 
Mienicompared to alternative i, the matrix W may now be 
Constructed where each WI entry may be computed by 


au LZ? 
Sc 
e? Fan 
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Each gt entry thus becomes an estimate of the ratio 
we Sen 
between the scale value of the j versus 1 alternative. 
iis letting S denote the scale value of the ua alterna- 


tive, the Wi; entries may also be denoted as 


S. 
a: 

19) x 

S. 
I 

Note, however, that 

5. So Se 

Be er 

Se S S 

1 k i 


iiremerore an additional n-1 estimates can be obtained by 


ul | ue 
Po e 
E 
La 


> 
Lu. 
è 


In general = — although all are estimates of 


> ER These estimates will not generally be equal since 


(n> 
N? 


anconsistencies of judges' response can be expected to occur 
frequently. In order to minimize the inconsistency of 

a judge's response and utilize all of the information con- 
tained in the SE matrix, a least-squares approach is 


mOllowed to obtain the value Ze: 





The procedure begins by rewriting 


S. 
De 
E S. 
l 
as 
log SÉ ae = OE S. 
or 
log SS OE z - log Ss, = 0 


neto re, the least-squares approach implies that the 


values S,, Sa, ..., S. are obtained by ame 
d 2 n ‘ o 


= 3 O log 1. S 
GK g [ 08 SE ( 08 > 08 s,)] 


and then obtaining the least-squares solution for the values 


St E dE EE che function Q. 
EE EE zunetion Q requires taking n partial 
Mates Of Q and setting each derivative equal to zero. 


Thus, 


t Torgerson, SIE and Me chods ot Scaling, 
feel 05-113. 
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The above equation may then be simplified to 


I m a 


HE log s. + 
1 *J WE 


I m3 
pa 


log s. = 0 
1 


enay, rewriting this equation as a function of Ze 


one obtains 


ims 
pa 
O 
UO 
=, 
Ni a 


log 5; 


= I 
en? n 


Recallins that the units are arbitrary for ratio scale data, 


mekt Choose the units value such that 


Il e 


log s. 
i=l Ce, 
n 


mere ore with the above simplification, which is not 


mieeassumption, the equation for S; may be expressed as 


INEA 


Le 
= an: 
j n 


Taking the anti-log of both sides of this equation 


welds the following expression for the estimate of 5, 


Hier 


un 
il 
ı A» 


(w. . ) 


EN 
e [Eq. 2] 


1 


os 





Mime sc mate rot the scale value of the e? 


ER Sj» may be computed by taking the geometric 


mean of the H 


column of the W matrix. One advantageous 
property of the geometric mean being used as an estimate 
Buche value of the a EE EE Ee gee column 
geometric mean 1s identically equal to the reciprocal of 
the ia row geometric mean. If the arithmetic mean would 
have been utilized the column mean would not necessarily 


Bear acreed with the reciprocal of the row mean since in 


Sener a | 


E 
SÉ 
es | 


(=) 


es | l 


where 


Emotes the arithmetic mean. 
It should be noted that when comparing highly dissimilar 
EN Ss ttems Such as an air-search radar and an electro-optic 


device the A matrix may have entries where as 100 and 


a UNS Se SE values can arise when one alternative 
Sot perform a given attribute while the other alternative 
Sees nave some Capability in the attribute. In this case values 


in the a: heen cw ile Die Weg = © and Ae ze To ac ecommodate 


Manse Gase the tollowing modification of the constant-sum 
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NEO cis As trrestedi Assign a value of zero to the Ss; 


estimate of the SEH alternative's worth omitting the 


: S E $ 
EA on Ore geometric mean for the 7 E INE 


This is deemed appropriate since it is reasonable to assume 


hat az an alternative receives a value Së = 0 then 
n 
Ber... Dt 2 
a = 0, since the i a systems inability to perform 


N el 
K EU EE bewUnarrected by its Comparison with 
the remaining n-1 alternatives. Also a Gi value of œ 
Semedims ne information except the E alternative does have 
Aa an the attribute. Since this information is 
wholly contained in the remaining n-l EE values, SÉ f œ 

h 


enen the geometric mean of the jt altecnative may be 


computed as 


n-m — 
S. = Ir ae 
! is1 H 
mer all Se 7%, 0, where m = number of BER values = œ, 


Mc nes peca ll Case 1S considered. This is the 
Base where nNelther alternative has any impact on the attri- 
Be Zünderzconsideration. Without specific instructions, 
Br ases may respond to this case by dividing the points 
equally between alternatives. The constant-sum procedure 
Nal chen produce erroneous results by calculating a posi- 
tive alternative's worth when none exists. However, this 
@eoolem may be eliminated by proper preparation of the 
fies tionnaire imstructing judges to omit the specific 


Somparisons where neither alternative has a positive impact 
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on the attribute under consideration. If all judges are 


unanimous in leaving the SES comparison blank then ze = 0 
and SÉ = 0. Thus, a value of zero is assumed for S; 
and s.. 

J 


Adopting the above procedure in the case when dissimilar 
alternatives are to be compared increases the importance 
of the analyst using a large number of judges. The constant- 
sum method does not take into consideration or weight the 
estimated SÉ values by the number of judges who responded 
to the comparisons of the alternatives. Thus, the values 
of s) are independent of the number of judges responding 
to the WW alternative versus all remaining alternatives. 
AS such, the constant-sum method does not require the 
judges to make all comaprisons on the questionnaire and 
encourages the judges to omit comparisons they are incapable 
of making. A large number of judges will reduce the 
probability of all judges leaving the same comparison of 
alternatives blank due to insufficient knowledge of the two 
irte rnatives. 

Mep o cedure yields estimates of the subjective worth 
pieecach of the alternatives for a given attribute. Let 
m denote the number of attributes over which the n alterna- 
Anes are to be compared. Therefore, after having performed 
additional m=l replications ot the constant-sum technique, 
i/o. , once for caen attribute, the following alternative- 


Atribute matrix V may be constructed. 





Alternative-Attribute Matrix 


DUO Ss 
i 2 m 
1 
2 
dliternatives” v 
f E 
n 


Mu each Columa represents the outcome values TE 
w n of tie constant-sum technique for a single attribute. 
The final step in obtaining the estimated values of 

the total ratio worth of alternative systems for the case 
ot the additive function form is obtained by multiplying 
the V matrix by the relative weights of importance attached 
Bosthe attributes by the decision-maker. Denote the 
attribute vector as A = (A, A545 EE A) Then, an 
estimate of the alternatives’ ratio worths considered over 


all attributes is computed by 


_ T 
la = AV 
where 
Matrix Or the relative importance 
of attributes 
T e 
V = the transpose of the V matrix 





The finalized X matrix values are on a ratio-scale 
where direct comparisons between alternatives is possible. 
As an aid to the decision-maker, however, it is suggested 


that the finalized X matrix be transformed by the formula 


X' = bx 


where b will be the scalar value necessary to raise the 
Seuapmem@eowltn the highest score to a value of 100 points. 
Thus, if the highest alternative has a value of 100 and 
another alternative has a value of 75 it is correct to 
interpret the results as the highest scored alternative 

is 1.53 times better than the other candidate. The results 
May also be presented as the lower-scored alternative is 
my 7/5 percent as effective over all attributes. 

Appendix E presents an example of the constant-sum 
method of obtaining estimates of the alternative's total 
Morth ratios for the air-search selection problem. The 
estimates of alternatives total worth ratios are then 
Eombined with the life-cycle cost solution to yield a four- 
dimensional solution. The decision-maker may use his 
expertise to combine the solution matrix to arrive at the 
meme culon Of a single system. Table III displays the 
meal solution ın matrix form tor the hypothetical air-search 


madar selection problem. 
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Tabie III 


FoursDmensieonal Solution Tn Matrix Form 


Male Time Ratio- 
Costs Horizon Externalities Worth 
Ion 8 DS 
power 
Arerma= 2 3.5 million 12 weight 58.04 
Eve space 
Systems 3 2.8 million 10 etc. 100 
ASAS On 8 67.8 


Pm cutline of the proposed cost-benefit methodology used 
arrive at the four dimensional solution is presented in 


Enpendix E, 


UN TERPRETATION OF RESULTS 

nes our damensiomal solution is to be used by the 
MeeisloOn-maker to arrive at a rational choice. This pro- 
cedure can aid the decision-maker as it presents the rele- 
vant information of the decision in a small number of 
variables. This small dimension will allow the decision- 
maker to use his expert judgement to select the best 
alternative based on his criteria. In many cases the 
Eaton matrix Table III may be used to directly select 
ma@empest decision. tin other situations more information 
MEN De required. These two cases are discussed in the 
remainder of this chapter. Both situations are discussed 


E Oase where externalities and expected lifetimes 


fo 





COMO ope Se Ttectión Of any alternatives. 
Alternatives having unacceptable externalities to the 
does non marerssmonld be eliminated from the list of 
systems under comparison. 

Sc EE has the lowest expected 
life-cycle cost and highest expected overall worth, then the 
selection criteria of dominance should be utilized. While 
the dominance technique is of limited value when many 
attributes are considered, for four attributes dominance 
Lele EE EE If one ignores externality 
Gosts, the aır-search radar example problem of Table III 
ne ve lle lend 1tselr to dominance decision criterion. 

tase oa terna live Nas both the lowest life-cycle 
cost and highest overall benefit value. In this situation, 
deee mane e bestal ternative becomes much more difficult. 
Eier a O e ract taat calculated expected benerfıt 
ratio values are dimensionless. Thus, if two alternatives 
EE and 100 respectively, it is true that 
Ei eeonedsalrernacıvye has twice the impact as the first. 
However, no direct estimate of how much an alternative will 
Mime emnlomoreceniyenmess of the platform is obtainable 
Droste constant sum method.  1£ one alternative is twice 
Io areas another alternative and still increases 
e a e eeens S by only two percent, costs may 
become —the sOverridine decision criterion. When the final 
Macias ta case [i matrix; additional information 


iii mhcdluned slime additional information required will 
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Danes tim tesot any one alternative's overall impact on 

e pe ace time miss ions Ne Only requirement is that the 
alternative chosen has a non-zero positive impact. Once 

the percentage of the overall impact for a single alternative 
is known, the remaining alternatives can be scaled accordingly. 
Thus, while the case II final matrix does not yield a direct 
solution for the analyst or decision-maker, it does eliminate 
the requirement of the analyst having to perform the task of 
conducting a separate study for each alternative to arrive 


at benefit values. 
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VI. CONCLUSIONS AND RECOMMENDATIONS 


Selecting military equipments by considering their 
impact on peacetime missions is one alternative method 
Br systems selection. For existing vessels with assigned 
Peaectime Mission responsibilities, the assumptions required 
o implement the proposed cost-benefit model are reasonable. 
However, even in the case of comparing existing military 
Ae ments Tor existing vessels it is difficult to arrive 
at valid estimates of the true costs and benefits associated 
with the various alternative systems. 

Como eo ne problem or Measuring the costs and 
Menertits of the various alternatives is the task of com- 
oming these elements into a measure of effectiveness that 
mm decision-maker may use to arrive at a rational choice. 
tica techniques that combine ali selection considera- 
tions into a single, dimensionless value for each alternative 
oo limited value to the decision-maker since no tradeoffs 
Sabe pertormed. However using a technique where no attempt 
made Ehe selection considerations also 
EE Value due to the information processing limi- 
gions of the decision-maker. 

Since assumptions are required to reduce the dimension- 
mpi; Or the SyStem Selection problem, it is appropriate to 
Meqduce the dimensionality only to a level the decision-maker 


may use to arrive at a rational choice which is consistent 
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with his expert evaluation of the presented information. 

In the proposed cost-benefit model the solution produced 

is a four-dimensional solution. The individual dimensions 
ae life-cycle costs, time horizons, externality costs, 

and the expected benefits of the alternatives. This dimen- 
sionality clearly falls within the maximum number of 
separate pieces of information that individuals may collec- 
tively evaluate when arriving at a rational choice. 

The proposed cost-benefit analysis uses a life-cycle 
cost estimating approach to measure an expected dollar cost 
for each alternative system. Using a life-cycle cost 
approach requires that all the relevant cost elements that 
occur over a system's lifetime be taken into account when 
arriving at a cost estimate. The major cost elements that 
the Coast Guard must consider will undoubtedly be manpower 
requirements. 

After the cost estimates of the alternative systems have 
been obtained the next step is to determine the benefits 
or each system. Multi-attribute theory is one technique 
available to the analyst that estimates the various alterna- 
tives worth over several peacetime missions. However, to 
use any of the available multi-attribute decision criteria 
requires many severe assumptions. Often the final solution 
produced using a multi-attribute analysis is very dependent 
ethe specific assumptions of the criteria chosen. Thus, 
reliance upon subjective authoritative judgement will have 


@memcontimuce when arriving at the final decision. 
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However, since the analyst has few options other than 
Mimi cil-deekhuoute techniques to evaluate alternative 
systems, the most important consideration is that the 
analyst and decision-maker are aware of the assumptions 
required to use a multi-attribute analysis when evaluating 
alternatives. 

Recommendations: No validation of the proposed cost- 
benefit model was possible. A validation of the model 
mioula De conducted after NOSC concludes the factor analysis 
Seethe attributes that describe Coast Guard missions. 

[eer cinarely, a valid verification of the cost-benefit 
model results will be diftficutl to formulate. Comparing 

the results of the final selection ordering of the cost- 
Meme lt model to the results of previously conducted studies 
ieee De caretully pertormed. The extent to which this model 
will aid the decision making process can only be determined 
Pemcomparing the results of the cost-benefit model against 
previously conducted studies which produced both good and 
moor results. 

e analysis lS also required to establish that the 
Sis ion=maker correctly expresses his relative importance 
Ene various attributes under consideration. One method 
that could be used to establish that the decision-maker 
actually selects alternatives consistent with his stated 
importance of attributes would be to examine past decisions 
of systems selected where the system's worth in each attribute 


je known. 
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Pocmenotal ly stiemexasStence Of the requirements 
necessary to apply multi-attribute decision theory to 
pmp itensianvoline Systems selection are often unprovable. 
Thus, in lieu of basing a final decision or recommendation 
Solely on the results of a single, highly detailed multi- 
attribute analysis, the prudent analyst may prefer to conduct 
several analyses on a broader level where each study uses 
a different multi-attribute criteria. Thus, the proposed 
æt benefit model should be used in Conjunction with the 
methodology being developed by NOSC when selecting alterna- 
tive systems from Naval inventory for existing Coast Guard 
EE the two methodologies require a different 
‘Set of assumptions, a high degree of correlation between 
A amn order of the alternatives in terms of the order 
the decision-maker would select the systems would tend to 
mMdicate that the results are somewhat independent of the 
w ons required to produce the results. If disagree- 
Ment exists between the rank ordered alternatives list each 
methodology yields, the analyst has few options but 
memrcentity the assumptions that produce the disagreement 
results. 

ome cnod currently exists to Calculate a 
Meaningful variance on the benefit ratio values calculated 
by the constant-sum method. However, due to the tendency 
Semiudees to respond in increments of two, five, and ten, 
this clearly indicates there exists a variance on the ratio 


meme onevVen In the Case where the judges possess complete 
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information of alternatives they compare. A Monte-Carlo 


ERT EE be conducted to establish the extent to 


which this variability will affect the outcome of the final 


rank ordering of alternatives. 
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APPENDIX A 
ee Ss TENTATIVE METHODOLOGY* 


Define all Military and Civilian Missions 


Establish Primary and Secondary Military and Peacetime 
Missions 


Establish SWBS Categories for Each Mission Area 
(SWBS-Mission Matrix) 


EStaplisheoysctems For Bach Category 
(Site mis Category Matrix) 


identity Equipment tor Each System Using SCSC 
and Navy Inventory Listings 


Pe op Ecu pment Characteristics Matrix 


Po Tse cal Constralints for Mission SWBS Categories 
(Using Mission Requirement Constraint List) 


oee e Each Equipment to the Critical Constraints of 
eR PE ropriate Mission SWBS Category 


MS anne in Weighting System Attributes 


EN ate ES en Equipment in terms or Each Weighted 
SWB ate co Ty 


Nopal Ot put altes Lor Each Equipment Considered 
Take Normalized Resultant Values and Weight Each 
Commensurate With It's Categories Impact on the 


ss ton (In EO (1) ) 


Rie ate importance ot Military and Peacetime 
Missions (Planner) 


Enamore den Equipments Multi- Mission Capability 
Normail1ize Output Values from Step 14 


EE EE EE Significance of Variation) 


Notes. Consider Human Factors After Final Equipment 


Lise oncluded. 


Presented with permission of Naval Oceans System 
Coco e iZ San Diego, California. 





APEENDIX B 
COS GUARD VESoEL REQUIREMENTS 


The "Need" column reflects the number of each class of cutter required 
to meet projected multiprogram cutter requirements. The "Have" column 
includes only those cutters in the present inventory which will not 
Buzmexeeeded their useful service life in the given year. The "Short" 
column is the difference between 'Need'' and ''Have.' The ''Short'' colum 
in 1986 represents the number of cutters that must be built during the 
next ten years if the Coast Guard is to have the capability to execute 
"program requirements as identified in the Cutter Plan. 





















































E z 

— 1926 | 
= W : 
ZS ? SE | 
GE | | à i 
¡A | 7 ” | 
Ge l 5 | | » 
ee SÉ E Age | 
Eeer Leck ee e Cell a, SS | 
Jan Sn Eee = ae | 
«Eu =z Tr = Se Al 
en = E | a X ' 
ze ; ; | f ] y 
Eon | S | d EE 

— wa - — 
4 e T » ! d x , - y” S 
EC Ee 1012) 13 | 
WMEC 14.71 25-217 : 85281107 2 a (30 cn 
A ae eS 
- = = los e om = es ~ = | ` er 5 
: = A E A E E E 
ee IS E DS? ESO A O 
EE = i TA 2t 
SS A a 
É A AS A A | 
A ES ae 
e x ` g t : 
R 4 } ns . P e t 
E e es SC 
. ! ? > t 
| 3 Ne i + E az, : E ' zs Së 
t e 49 iS P 1 2G t 15 Be ; 
7 ó | SE IA A | 
3 d 4 

$ 

to. l + t e i 
O E SE q 10 l K 5 2 
= ro. ` ~ t . ; 
Be Er an ea, 

7 nd 

EE Ee 
a 4 ` 
O A E eae ; = 
i ” | e ) ‘ - t 
ET RATE | 
- - H - ==> 
t ( q y J : 





Adopted from CG-380-4, Cutter Plan, 
Moe comuleation dtd 4 Apr 1975 
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APPENDIX C 


CESAR Oem Ooo lbbe ATTRIBUTES 


The following is a partial list of shipboard functions 


that NOSC is studying to describe the peacetime missions of 


the Coast Guard. 


tiletmweresiules will be the attribute list 


required for the proposed cost-benefit model. Definitions, 


whenever possible, were obtained from the Department of 


Defense Dictionary of Military and Associated Terms, of 


3 September 1974. 


wn Surveillance: 


The systematic observation of airspace 

by electronic, visual, or other means 
primarily for the purpose of identifying 
and determining the movements of aircraft 
and missiles, friendly and enemy, in 
Ener SEET EH 


Semiand and Control: The exercise of authroity and direction 


Countermeasures: 


by a properly designated commander over 
assigned forces in the accomplishment of 
Mises LOM omand and control functions 
are performed through an arrangement of 
personnel, equipment, communications, 
facilities, and procedures which are 
employed by a commander in planning, 
aeee e e ordinati a and Controlling 
forces and operations in the accomplishment 
oasis Ss Don: 


KEE EE Science which by 

tne employment of devices and/or techniques 
has as its objective the impairment of 

the operational effectiveness of unfriendly 
AGC Vale ye 


Long Range Navigation: The systematic determination of the 


position of one's vessel by electronic, 
visual, or other means when the vessel 
ise mee xcess or 10 nautical miles from 
chartered landmasses. 
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Inc Navigation —~ ihe systematic determination of the 
E position of one's vessel by electronic, 
visual, or other means when the vessel 
is less than 10 nautical miles from 
chartered landmasses. 


Subsurface Surveillance: The systematic observation of 
subsurface areas, places, persons, or 
things by visual, aural, electronic, 
photographic, or other means. 


Surface Surveillance: The systematic observation of surface 
areas, places, person, or things by 
Vista Dro Eeer bt 
or other means. 


Surface-to-Air Communications: A method or means of 
conveyins ınrermatıon of any kind from 
ae umtLace vessel to fixed wing or rotary 
a at. 


Surface-to-Shore Communications: A method or means of 
Conve io IntOrmatron Of any kind fron 
ares sel to a shore Communications station. 


Surface-to-Surface Communications: A method or means of 


conveying intormation of any kind between 
two surface vessels. 
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APPENDIX E 
EAM De sneer ENG THE CONSTANT-SUM METHOD 


A? amp le Of usina the constant-sum method is presented 
Meier reader. The problem presented obtains ratio benefit 
Mates or the original air search radar selection problem 
previously discussed. 

Let the following matrices denote the responses of judges' 
whose task was to divide 100 total points within each pair 
of alternatives. Each judge was instructed to divide the 
points 1n terms of the alternatives positive impact 
Etc eDictronhmance Of the Specified attribute. Further, 
the judges were informed that the awarding points as (50,50) 
mimbed that Down alternatives were equally effective within 
er attrioute while (75,25) point split indicated that the 
MES CT alternative had three times the positive impact on 
the attribute as the second alternative. All judges were 
Ios tructed to omit comparisons where they were 
wenam lar with one or both alternatives. 

Mises ies o edges response are presented below. 
meee entries indicate a judge chose not to make specific 


comparisons. 
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Alternative 
System 


Alternative 
System 


UA 


2 


Alternative System 


AFER TEUTE 1 


l 2 3 4 1 2 3 4 
= 40 60 55 l - 45 55 50 
DU GE u = 05. VoU 
40 30 - 2:5 A = 40 
45 45 75 - 4 50 40 60 - 
Judge 1 Judge 2 
1 2 5 4 
= 75 
` 50 
25 S 
50 S 
Judge 5 
ATIRIBUIE 2 
Alternative System 
l 2 3 4 1 2 3 4 
= O ZO ie 60 60 50 
das 55 45 EEO so 45 
30 45 - 25 Ss as ë > 
Ee E EE = 
Judge 1 Judge 2 
i 2 5 4 
= 50 55 
50 = 
65 S 
Judge 3 


89 





Ee 


Alternative System 


1l 2 5 4 1 2 3 4 
1 - A O Y l - 40 70 
Alternative 2553 - 50 55 2 - 
System 
Sel Sue 60 3 60 - 
AAG S455 8400 - 4 30 - 
do Cl Jüdge z 


hos 50 

2.850) 70 

3 = 

4 30 = 
Judge 3 


EII wile none above Matrices represent SE walmes: 
Bus, the a; entry One ee atribute | implies thart 
Be second system received 40 of the orıgınal 100 points 
fvded among the first and second alternatives. 

After obtaining the E voee e nert cep Ss toO 
@emstruct the A matrices for each attribute. Each entry 
in the A matrices is computed by 


a 


2 d o 
1) 


judges *J 


li 


a 


Miteeresults Of this computation leads to the following: 
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ATTRIBUTE 1 ATTRIBUTE 2 


Alternative Systems 


1 2 3 4 1 2 3 4 
1 2 SOS 52.5 i 57.5 60 35 
A = Alternative 2 57.5 - 67.5 55 2 IS 55 45 
Systems 
3 Som Saas EE 3 40 45 : 33.3 
4 47.5 45 E 4 65 55 66.7 - 
ATTRIBUTE 3 
Alternative Systems 
il 2 3 
1 - 47.5 42.5 65 
2 525 = 50 62.5 
3 SS 50 - 60 


4 53 37.5 40 - 


Using the above values in the A matrices the next step of the 
constant-sum procedure is to construct the W matrices for each attribute. 


Each element in the W matrix is computed by 


The results of this computation leads to the following: 


el 





ATTRIBUTE 1 AIRURTBUTE 72 


Alternative Systems 


ik 2 5 4 1 2 5 4 
ei e LLL Eh Poe eS E 
Alternative e bé es US 272 2 .74 1 1.22 WR 
Systems 
OS 48 1 .48 A “oz OU 
A a y A el ESO IA 
ANUIES 


Alternative Systems 
1 2 5 4 


171 SU ALS O 
Zul. A IL 120% 
esse i D5 


4 .54 P O 


TUcmurmgeetcecxample the scale values S are now 
eaula ted tor each attribute. To calculate the Bs values 


mse the following formula: 


These z values for each alternative in each attribute 


are presented in the following matrix (V): 





ALITERNATIVE-ATTRIBUTE MATRIX 


= 


Attribute | Attribute 2 Attribute 3 


1 .92 .98 .95 

Alternative 2 SC 12.08 .86 
Systems 

5 19865 ios .84 

4 .90 .69 1.47 


Next, assuming that the decision-maker has expressed 
the relative importance of increasing the capability of 
mem@rormime attributes 1, Z, and 3 as 0.6, 0.2, 0.2, 
meomecuively, an overall estimate of the alternatives 
ratio-benefits may be calculated by combining the weights 
of the attributes and values in the alternative-attribute 


meer ix as follows: 


where: 


> 
li 


AS SEO ene relative weights of attributes 


< 
U 


Transpose of the alternative-attribute matrix 


Performing this calculation on the example of measuring 
Miembenetits Of the four air-search radars the following 


results are obtained: 





Sn 
So UL. OS E .09 


295 706 .84 1.47 


Ee 


Eten X; value above represents an estimate of a ratio- 
benefit value of the SEH alternative. However, to aid the 
decision-maker it is recommended to transform the values 


on a scale where the maximum X; value equals 100. Thus, a 


transformation of the x; values by 


at BoC? where b = 69.93 


X} = [65.73 58.04 100 DES | 
Finally, these values are combined with the life-cycle 


mest Vectors to obtain the final four-dimensional solution 


matrix. 
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APPENDIX TE 


CAINE: TRAE PROPOSED COS1- BENEFIT METHODOLOGY 


Obtain alternative systems list from the Navy's inventory. 


Eliminate any systems which could not be installed 
ter reasonable vessel modifications. 


Identify peacetime missions of the platform. 


menei ty aatri butes required to perform the 
peacetime missions [Results of NOSC study]. 


Determine relevant life-cycle and externality costs 
for each alternative system. 


Utilize subjective judgement from systems experts to 
obtain expected benefit ratios of each alternative. 
This w111 require the preparation of a questionnaire. 


Establish the relative importance the decision-maker 
places on increasing performance of the various 
attributes. 


Obtain final estimates of each alternatives overall 
ratio value by combining steps six and seven. 


Combine the results of steps five and eight to construct 
a four-dimensional solution vector for each alternative. 


Remove from consideration any system with completely 
Uegi@eccoraple externality Costs Or time horizons. 


Apply the dominance criterion on the remaining alterna- 
tives. If a solution is produced, select that system. 


Im the case where no solution is produced using 
dominance, further analysis must be conducted. The 
analyst must arrive at an estimate for any non-zero, 
positive alternative of the percent of overall impact 
1t will have on peacetime missions. 


scale the remaining alternatives benefits once one 
System's benefit has been obtained to arrive at direct 
estimates of the benefits for all alternatives. 


Po Ene decision- maker to arrive at a rational choice 
of the best system using his expertise to subjectively 
radeon values in the solution matrix. 
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